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Process  I  mprovement  I  mprovement” 


The  CMMI  Product  Suite  provides  a  foundation  for 

enterprise  wide  improvement  and  adds: 

•  New  emphasis  on  products  and  services  as  well 
as  process 

•  Emphasis  on  both  process  capability  and 
organizational  maturity 

•  Early  emphasis  on  Measurement  and  Analysis 
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CM  M I  I  s  I  ntegrati on  and  I  mprovement 

CM  M I  supports  process  i  ntegrati  on  and  product 
improvement 

CMMI  integrates  multi  pie  disciplines  into  oneprocess- 
i  mprovement  framework  that  el  i  mi  nates 
i  nconsi  stenci  es  and  reduces  dupl  i  cati  on. 

CMMI  provi  des  a  framework  for  i  ntroduci  ng  new 
disci  pi  i  nes  as  needs  ari se  and  therdbre  reduces  the 
cost  of  implement] ng  model -based  i mprovement 

CMMI  is  designed  to  minimize  the  impact  on  legacy 
process  i  mprovement  efforts  and  i  nvestment. 
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CM  Ml  Model  Structure 


Staged 


Continuous 


Maturity  Levels 
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Focus 


CMM 


Continuous 
Process 
Improvement 
(2  PAs) 


Quantitative 
Management 
(2  PAs) 


Quantitatively 

Managed 

(4) 


■Organizational  Process  Performance  (OPP) 
■Quantitative  Project  Management  (QPM) 


Process 
Standardization 
(11  PAs) 


Basic  Project 
Management 

(7  PAs) 


Managed 

(2) 


Initial 

(1) 


Defined 

(3) 


■Requirements  Development  (RD) 
■Technical  Solution  (TS) 

■Product  Integration  (PI) 

■Verification  (VER) 

■Validation  (VAL) 

■Organizational  Process  Focus  (OPF) 
■Organizational  Process  Definition  (OPD) 
■Organization  Training  (OT) 

*  Integrated  Project  Management  (IPM)  * 
■Risk  Management(RSKM) 

■Decision  Analysis  and  Resolution  (DAR) 


■Requirements  Management  (REQM) 

■Project  Planning  (PP) 

■Project  Monitoring  and  Control  (PMC) 

■Supplier  Agreement  Management  (SAM) 
■Measurement  and  Analysis  (M&A) 

•Process  and  Product  Quality  Assurance  (PPQA) 
■Configuration  Management  (CM) 


•Organization  Environment 
for  Integration  (OEI) 
•Integrated  Team  (IT) 


*  Additional  PA  goals  and 
activities  added  for  IPPD 


Ad  hoc,  chaotic  processes 
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CM  M I  -SE/SW/I 
Conti  nuous  E 


■Process 
Management 


Organizational  Process  Focus  *  Project  Planning 
■  Organizational  Process  *  Project  Monitoring  and 

*  Definition  Control 

*  Organizational  Training  *  Supplier  Agreement  Mgmt 

*  Organizational  Process  *  Integrated  Project  Mgmt 

*  Performance  *  Risk  Management 

*  Organizational  Innovation  •  Quantitative  Project  Mgmt 

and  Deployment 


IPPD 


■  Organizational  Environment 
for  Integration 
*  Integrated  Team 


Project 

Management 
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Engineering 


Support 


*  Requirements  Management 

*  Requirements  Development 

■  Technical  Solution 

*  Product  Integration 

■  Verification 

■  Validation 


*  Configuration  Mgmt 

*  Process  and  Product 
Quality  Assurance 

*  Measurement  &  Analysis 

*  Decision  Analysis  and 
Resolution 

*  Causal  Analysis  and 
Resolution 


Supplier  Sourcing 
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Process  Capabi  I  i  ty  L evel  s 


5  Optimizing 


4  Quantitatively  Managed 


3  Defined 


2  Managed 


1  Performed 


0  Incomplete 
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M  easurement- re!  ated  Process  A  reas 

Project  Management 

•  Project  Planning,  Project  Monitoring  and 
Control,  Software  Acquisition  Management 

•  Integrated  Project  Management,  Risk 
Management,  Quantitative  Project 
Management 

Process  Management 

Engineering 
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Basic  Project  Management  PA's 
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A dvanced  Proj  ect  M  anagement  PA '  s 


©  2003  by  Carnegie  Mellon  University 


Page  12 


Carnegie  Mellon 

Software  Engineering  Institute 


M  easurement- re!  ated  Process  A  reas 

Process  Management 

•  Organization  Process  Focus,  Organization 
Process  Definition  Organization  Training 

•  Organization  Process  Performance, 
Organization  Innovation  and  Deployment 
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Basic  Process  M anagement  PA's 
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Advanced  Process  M  anagement  PA ' s 
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E  ngi  neeri  ng  Process  A  reas 


Anal 

revie 

data 
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SW-CMMvl.l  Common  Features 


Commitment  to  Perform 

Establish  an  Organizational  Policy 


Ability  to  Perform 

Provide  Resources 
Assign  Responsibility 
Train  People 
Activities  Performed 
P  Ian  the  P  rocess  ^ 

P erfbrm  the  P  rocess 


Monitor  and  Control  the  Process 


CMMI  Common  Features 


Commitment  to  Perform 

Establish  an  Organizational  Policy 


Ability  to  Perform 
P  Ian  the  P  rocess 
Provide  Resources 
Assign  Responsibility 
Train  People 


Mi  ii  unit  HH!  Ill  A  Analysis 

Measure  the  Process 


:e  the  Measurements 


(Specific  Practices) 


Directing  Implementation 

Identity  Si  Involve  Rel.  Stakeholders 
Manage  Configurations 
Monitor  and  Control  the  Process 
ollect  Improvement  Information 


Expanded  in  the 
Meas u rement  and  Analysis  PA 


Verifying  Implementation 

Review  with  Org.  Management  j 
Review  with  Project  Management 
Objectively  Verity  Adherence 


I  HI 


eniying  implementation 

Review  Status  w/  Higher-Level  Mgt 

Objectively  Evaluate  Adherence 
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M  easurement-  Re!  ated  G  Ps 

“Monitor  and  control  the  process  against  the 
plan  and  take  appropriate  corrective  action." 
(GP2.8) 


"Collect  work  products,  measures, 
measurement  results,  and  improvement 
information  derived  from  planning  and 
performing  the  process  to  support  the  future 
use  and  improvement  of  the  organization's 
processes  and  process  assets."  (GP3.2) 
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The  M  easurement  Thread 

Two  uses  of  measurement:  project 
management  and  process  improvement 

As  the  organization  matures,  the 
sophistication  and  uses  of  measurement 
increase 


©  2003  by  Carnegie  Mellon  University 


Page  20 


Carnegie  Mellon 

Software  Engineering  Institute 


Agenda 

A  process  framework:  CMMI 

Measurement-related  Process  Areas 

The  Measurement  and  Analysis  Process 
Area 


Challenges  for  Process  Maturity  and 
Capability 


©  2003  by  Carnegie  Mellon  University 


Page  21 


Carnegie  Mellon 

Software  Engineering  Institute 


Support  Process  A  reas 
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M  easurement  and  A  nal  ysi  s  -  Purpose 

“The  purpose  of  Measurement  and  Analysis  is  to 

jj 


"The  Measurement  and  Analysis  process  area 

by  providing  practices 
that  guide  projects  and  organizations  in  aligning 
measurement  needs  and  objectives  with  a 
measurement  approach  that  will  provide  objective 

,  and  taking  appropriate  corrective 

actions.” 
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M  easurement  the  i  n  CM  M  ®-SW 

"...practices  that  are  necessary  to 
determine  status  related  to  the  process. 
Measurements  included  in  this  common 
feature  are  used  to  control  and  improve 
the  process." 

Measurement  practices  found  in  Activities 
Performed  as  well. 
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M  easurement  and  A  nal  ysi  s 
Objectives 

The  integration  of  measurement  and  analysis 
activities  into  project  processes  supports  the 
following: 

•  Objective  planning  and  estimating 

•  Tracking  actual  performance  against  established 
plans  and  objectives 

•  Identifying  and  resolving  process-related  issues 

•  Providing  a  basis  for  incorporating  measurement 
into  additional  processes  in  the  future 
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M  easurement  and  A  nal  ysi  s 
Goals 

Align  Measurement  and  Analysis  Activities 
Provide  Measurement  Results 
Institutionalize  a  Managed  Process 
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Activities  for  Goal  3 

Institutionalize  a  Managed  Process 

Establish  an  Organizational  Policy 

Plan  the  Process 

Provide  Resources 

Assign  Responsibility 

Train  People 

Manage  Configurations 

Identify  and  Involve  Relevant  Stakeholders 

Monitor  and  Control  the  Process 

Objectively  Evaluate  Adherence 

Review  Status  with  Higher-Level  Management 
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I  SO  15939-  Software  M  easurement 

Process 

Defines  a  process  applicable  to  all 
software-related  engineering  and 
management  disciplines. 

The  process  is  flexible,  tailorable,  and 
adaptable  to  the  needs  of  different 
users. 
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M  appi  ng  to  I  SO  15939  -  1 


_Rec|uesUoi__ 

Measurement 


Information 

Needs 


Engineering  & 
Management 
Processes 


User  Feedback 


Analysis  Results 


Core  Measurement  Process 


Establish  & 
sustain 
meas  urement 
capability 


Align 

measurement 
with  business 
needs  & 
objectives 


Measurement 

Plan 


^Evaluation 

Results 


Perform  & 
provide 
meas  urement 
results 


Data  & 
Results 


Analysis 

Results 


Evaluate  and 


improve 
meas  urement 


Storage  of  Measurement  Data  &  Results-* 


Performance 

Measures 


Evaluation  Results 


Align  with  Needs  &  Objectives 

SP  1.1  Establish  measurement  objectives 

SP  1.2  Specify  measures 


Improvement  Actions 


M&A  Specific  Goals: 

Perform  &  Provide  Results  1.  Measurement 

SP  2.1  Collect  measurement  data  objectives  and  practices 

are  aligned  with  identified 

SP  2.2  Analyze  measurement  data  information  needs  and 


SP  1.3  Specify  data  collection  &  storage  procedures  SP  2.3  Store  data  &  results 


SP  1.4  Specify  analysis  procedures 

Adapted  from  presentation  by  Joe  Jarzombek 
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SP  2.4  Communicate  results 


objectives 

2.  Measurement  results 
that  address  identified 
information  needs  and 
objectives  are  provided 
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M  appi  ng  to  I  SO  15939  -  2 


_Rec|uesUoi__ 

Measurement 


Information 

Needs 


Engineering  & 
Management 
Processes 


User  Feedback 


Analysis  Results 


Core  Measurement  Process 


Establish  & 
sustain 
meas  urement 
capability 


Goal  3  I 

Institutionalize  a  L= 

Managed  Process 

Establish  &  Sustain 


Process 

GP  2.1  Establish 
organizational  policy 

GP  2.3  Provide  resources 

GP  2.4  Assign  responsibility 

GP  2.5  Train  people 


Align 

measurement 
with  business 
needs  & 
objectives 


Measurement 

Plan 


^Evaluation 

Results 


Perform  & 
provide 
meas  urement 
results 


Data  & 
Results 


Analysis 

Results 


Evaluate  and 


improve 
meas  urement 


Storage  of  Measurement  Data  &  Results-* 


Performance 

Measures 


Evaluation  Results 


Improvement  Actions 


Allan  with  Needs  &  Objectives  Perform  &  Provide  Results 


GP  2.2  Plan  the  process 

GP  2.7  Identify  and 
involve  relevant 
stakeholders 


GP  2.6  Manage 
configurations 


Evaluate  &  Improve 


GP  2.8  Monitor  & 
control 

GP  2.9  Objectively 
evaluate  adherence 

GP  2.10  Review  status 
with  higher-level 
management 
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CM  M I  -SE/SW  vl.  1  Compared  to 
CMM-SW  vl.l 

Organizations  using  SW-CMM  vl.l  should  be 
able  to  transition  to  CMMI  by  focusing  on  the 
following  changes: 

•  Mnnsuiiprinsnt  cirid 

*  Risk  Management  &  Decision  Analysis  and  Resolution 
at  L3 

9  Expansion  of  Software  Product  Engineering 


Most  SW-CMM  v2  Draft  C  updates  have  been 
incorporated. 
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C  hal  I  enges  for  SW-C  M  M 
Organizations 

Consistent  measurement  process  or 
approach 

Integration  of  measurement  into  processes 

Institutionalization  of  Measurement  and 
Analysis 
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Consistent  M  easurement  Process 

Practices  describe  a  process  for 
measurement 

•  No  consistent  guidance  for  how  to  do 
this  in  CMM-SW 

•  Guidance  addresses  both  measurement 
as  associated  with  ‘activities  performed’ 
and  other  common  features 
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Expl  i  cit  References  to  Use  of 

Measurement 

“Calls”  to  measurement  from  other 
process  areas 

Requires  integration  into  the  process  for 
data  generation  and  information  use 

Plan  for  measurement  as  part  of  process 
definition 
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I  nsti  tuti  onal  i  zed  M  easurement 
Process 

As  a  process  area,  Measurement  and 
Analysis  must  be  institutionalized 

Includes  evaluating  how  well  it  is  working 

May  be  difficult  given  how  it  touches  all 
other  process  areas 
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What  you  can  do . NOW 

Review  and  document  your  existing 
measurement  and  analysis  activities  and 
procedures 

Evaluate  the  value  of  your  existing 
measurement  and  analysis  activities 

Integrate  Measurement  and  Analysis  into 
your  processes  and  train  it 

Establish  an  organizational  infrastructure  to 
support  measurement  and  analysis 
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I  ntegrad  ng  M  easurement  and 
Analysis  into  Processes 


Where  are  the  data  generated  and  how? 

Who  needs  to  use  the  information  and  when? 
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ETVX  Derived  Measures 


•  T  i  me  to  perform  tasks  •  Output/(  I  nput+T asks+V  &  V ) 

•  T  i  me  from  assessi  ng  entry 

cri  teri  a  to  meed  ng  exi  t  •  1-  ( Outputs  f  ai  I  exi  t/total 

criteria  outputs) 

•  I  nput  meed  ng  entry/T otal  I  nput 
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Goal  -Dri  ven  Software  M  easurement 


Step  1:  Identify 
your  business 
goals 


Step  2:  Identify 
what  you  want 
to  know  or  learn 


Step  3:  Identify 
your  subgoals 


Step  4:  Identify 
the  entities  and 
attributes 


Step  5: 
Formalize 
your 

measurement 
goals 


Step  6:  Identify  your  measurement 
questions  &  indicators 


Step  8:  Define  and  document 
measures  and  indicators 


Indicator  T emplate 

Objective  - 

Question  - 


Iflnifc- 


Inputs 

Algorithm 


Assumptions  “ 


■III 


Planning 

Tasks 


Data  Elements 

1  2  3  4  5 


Task  1 

50 

N 

Y 

Task  2 

Y 

Y 

Y 

Task  3 

Y 

Y 

Task  n 

N 

Y 

Step  9:  Identify  the 
actions  needed  to 
implement  your 
measures 


Step  7 :  Identify  the  data 
elements 


Data 

Elements 


Size 


Defects 


Avail 

Source 

+ 

QA 

0 

CM 

- 

7 

0 

Etc. 

+ 

• 

• 

Step  10:  Prepare  a  plan 

Verification  and 
action  plans 
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M  appi  ng 
of  MS* A 


to 

I  ndi  cator 


Store 
Data  & 
Results 


INDICATOR  TEMPLATE 


Measurement  Goal  # 


Objective 
Questions 
Visual  Display 


lnput(sj 


Data  Elements 

Responsibility 
for  Reporting 
Form(s) 

Algorithm 

Assumptions 
Interpretation 

X-reference 
Probing  Questions- 
E  volution 
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In  the  End . 

Much  better  preparation  at  lower  levels  of 
maturity  for  achieving  the  higher  levels 
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For  M  ore  I  nformati  on 

Go  to  the  SEI  Website 

•  http://www.sei.cmu.edu/sema 

•  http://www.sei.cmu.edu/cmmi 

Contact  SEI  Customer  Relations 

•  Customer  Relations 
Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213-3890 

•  Phone,  Voicemail,  and  On-Demand  FAX:  (412)  268-5800 

•  customer-relations@sei.cmu.edu 
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Contact  I  nformati  on 

Dave  Zubrow 
3118  SEI 

Camegi  e  M  el  I  on  U  ni  versity 
Pittsburgh,  Pa  15213 

412-268-5243  (v) 
412-268-5758  (f) 

dz@sei  .cmu.edu 
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